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ABSTRACT 


This study addresses the problem of uncertainty in the 
aggregation of subsystem eost estimating relationships (CERs) 
for destroyer type naval ships. The case of correlations 
between subsystems is discussed with respect to total cost 
estimates, total cost variance, and prediction intervals. 
The joint generalized least squares method (JGLS) is devel- 
oped and applied to the ship cost estimating problem. The 
models analyzed were developed by D. M. Hernon and R. R. 
McCumber, Estimation of Destroyer Type Naval Ship Procure- 
ment Costs, utilizing the data base from Resource Management 
Corporation Report CR-058, the Navships Cost Model. One 
model utilizes 9 subsystem CERs to obtain a total cost 
estimate, while the second model utilizes 4 subsystem CERs. 
resolution methods were used for purposes of comparison; 
the JGLS method assuming correlated subsystems, the least 
pes method assuming correlated subsystems, and the least 
squares method assuming indepencent subsystems. The JGLS 
method is shown to provide the most meaningful results for 
correlated subsystems. A computer program and user's guide 


ele sprovided to conduct JGLS analysis. 
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ie ODUCT ION 


του ο ου οπου ας, Congressional concern, апа а 
continuing need for better planning estimates, it is impera- 
tive that new techniques be developed and old techniques 
τα Τη order to obtain better estimates for major weapon 
system procurement and construction. Along with these tech- 
niques a better understanding of the factors and forces that 
determine cost is required. 

"The аа есе осел ο тс paper is with Naval- ship 
Meeculrement and construction costs. The cost of a ship is 
a result of many factors and forces all of which it would be 
impossible to define and measure. Thus this cost is subject 
to conv When estimating the cost of a ship it is 
necessary to provide both the estimate itself and as clear a 
Picture as possible of the variability surrounding the 
estimate. 

The general objective of this paper is to analyze the 
Variability of ship cost estimates with respect to the Joint 
Generalized Least Squares (JGLS) estimation technique, and 
the Least Squares (LS) regression estimation technique. It 
is hypothesized that the Joint Generalized Least Squares 
Estimation technique takes advantage of additional informa- 
tion available and allows a more meaningful statement of 


the variance of a ship cost estimate. 





ШІ NAVAL SHIP PROCUREMENT AND CONSTRUCTION COSTS 
Naval ships may be thought of as major weapon systems 
eensisting of numerous subsystems including: 


Propulsion 
Hull 
Weapons and fire control systems 


Auxiliary 
Шеге are two basic methods used to predict ships costs. 

ШИ Песпо is to estimate the construction costs for each 
ESvscen, which are then summed to obtain total ship cost, 
Eni and 6|| rhe other method is to estimate total ship 
cost by using the performance and operational characteristics 
such as, speed or number of missile launchers as explanatory 
variables, [Ref. 2-3]. 

— The first method is the one of concern in this paper. 
Here the subsystem costs are estimated by using the physical 
and performance characteristics of the ship as explanatory 
Variables, normally utilizing the Standard Linear Least 
Squares multiple regression technique., Weight is often used 
as a primary explanatory variable in addition to many other 
characteristics. In order to make meaningful statements 
τς the variability of the total cost of the ship some 
aggregation technique must be employed on the individual 
Subsystem relations. The aggregation technique used depends 
upon the assumptions concerning the correlation of distur- 
bances that exist between the subsystem relations. If the 


assumption of independence between subsystem relations can 





be made ( a very restrictive assumption) straightforward 
linear combinations may be used to estimate total cost 
variance and prediction intervals; call this method LS 
(independence). This would seem a highly suspect assumption 
νο the interdependencies of subsystems aboard ships. 

A more reasonable assumption would be that there are corre- 
lations between subsystems. If these interdependencies are 
recognized, methods do exist to make more meaningful state- 
ments about the uncertainty surrounding total cost. An 
extension of the least squares method may be made by con- 
structing an estimated covariance matrix of the least squares 
estimates, assuming correlated disturbances; call this method 
LS (correlated). Finally, if correlations between subsystems 
are assumed, the joint generalized least squares technique 
allows this information to be used in determining a set of 
joint estimates and in constructing an estimated covariance 
matrix of the joint estimates. This assumption is less re- 
strictive than the indepencence assumption and in fact 

Ada provide more meaningful results; call this method 
JGLS. Discussion and development of these three methods is 
contained in Section II, Nature of the Problem and Section 


III, Methodology of Joint Generalized Least Squares Estimation. 





ІІ. NATURE OF THE PROBLEM 
E CENT SHIP COST ESTIMATING MODELS AND THE TREATMENT OF 
U CERTAINTY IN AGGREGATE PREDICTIONS. 


l. Resource Management Corporation Report CR-058 to 
NAVSHIPS 


Resource Management Corporation derived a statistical 
ee model for NAVSHIPS in which ship construction costs are 
estimated by subsystem and then aggregating these costs to 
weve ab Basic Contract Cost, and Total Ship End cost. The 


following subsystem breakdown was used: 


Ша Та ЕШ TEC ES 

ο cu NO 7 Armament 

3 Electrical 8 Design and Engineering 
ο ο ІСІ ОП апа control 9 Construction Services 


5 Auxiliary 
The summation of these nine cost categories plus profit апа 
риерпеас was defined as basic contract cost and formed the 
nine-subsystem cost model. RMC also developed a condensed 
four-subsystem cost model composed of the following categories: 


Ι΄ Group ШТІ ουσ and Engineering, 
| DoncppuctiognsServices 


ποσο Group 7 Shr Opis ions, Auxiliary 


3 Armament Group I i r (Electrical, 
Communication and Control 


IO Шар Group EEG b Colne 
Meo, the summation of these four cost categories plus 


profit and overhead was defined as basic contract cost. 





In determining total end costs RMC used NAVSHIPS 
records of the Shipbuilding and Conversion, Navy (SCN) fund. 
NAVSHIPS hardcore cost was subsequently defined as basic 
contract cost plus miscellaneous end costs and electronics 
ο. ουδ. The total end cost then became NAVSHIPS hardcore 
Sas Plus weapons end cost. CERs were developed from the 
data base for predicting basic contract cost and miscellane- 
ous end cost. No CERs were developed for electronics or 
weapons end costs. 


The models were developed for six different classes 


Ol ships: 
l. Aircraft Carriers ο πας) 
e. Destroyer pM RIDDUSDIONS 
3. Submarine 6. Patrol/minesweeping 


The area of interest in the Hernon and MeCumber paper, which 
Will be described next, and also in this paper is with the 
destroyer models developed. Reference 6 gives the full 
details of the RMC study and results. 

Taking now a point of departure from the general RMC 
study development, their treatment of uncertainty will be 
discussed. The treatment of uncertainty involves basically 
two steps. The first step is to develop the best set of 
CERs from the data available based on a regression strategy 
which outlines the basic statistical properties to be used as 
criteria in the choice. The second step is to analyze and 


report as thoroughly as possible the variance which surrounds 





τν 15 developed and, particularly, their aggregation to 
13 total cost. 

Ivo points arise from the HMC study with respect to 
the treatment of uncertainty. In the first, RMC uses the 
eoerrielent ci determination, RES as a measure of the good- 
ness of fit of the regression equation to the data, where 


6 cuc 
(Y, ns Y) 


The ratio of the sum of 

squares explained to the 

total sum of squares of Y 

adjusted for the mean. 
NS statistic tends to overstate the goodness of fit as it 
does not take into consideration the degrees of freedom. A 
more acceptable statistic would have been the adjusted 
coefficient of determination (adjusted for degrees of 
freedom) where Ri”, is defined below [see Ref. 7] 


Bee 
Re E n-k α E 
ADJ 1 τε. ὁ 

nep ατα 


a is the observation 


where са E M c 


πο ο οὐ point Concerning the reporting of total 
cost variance deals with prediction intervals on predicted 
Meret cost. The RMC study implicitly assumes that the errors 
MiP tne esvimates Of costs for the individual subsystems are 


independent of one another (non-correlated), though they 


ДЕЛІ 





ШЕНІ το state this assumption directly. This seems highly 
ble Ty since one shipyard produces several subsystems for 
сипар апа спе factors that contribute to the errors in the 
estimates of one subsystem may very well be the same or 
partially the same as those that contribute to the errors 
in the estimates of another subsystem. The allocation of 
overhead is one example. The factors that contribute to the 
ers in estimating costs for the propulsion and auxiliary 
Subsystems might very well be the same since these subsystems 
are in actuality very much dependent upon one another in the 
ship itself. 

Шел 15 not reported directly in the RMC study, 
e cost variance is treated as the summation of the 


1106 not explained in the individual subsystem CERs. 


where V is total cost 


πο е Vartance col 
subsystem i 


L Ds the number of 


subsystems in the 
model 


есас топ сет атс топ total eost are reported in 
the RMC study as the summation of the individual subsystem 
prediction intervals, where predicted cost is the summation 


of the subsystem predicted costs. 


live 





= 
y 
O 
I 
O 
Q 
1 


predicted cost for subsystem i 


I 
11 


2 -1 
1 5, (1 + Xg' (x' X) Χρ) 


Оема гарот ол Tor the ith subsystem 
Acting as if the subsystems are independent may lead to 
Сирс Байсал overstatements of the confidence one should have 
in any given total cost estimate as this paper will endeavor 
to show. 
L (ii on oí Destroyer Type Naval Ship 

Puc@umememuscooto, by D. M. Hernon and 

Го τε Πρες JP. 

This paper is essentially an extension of the study 
ШЕ О бп of the RMC study. The objective as stated was, 


ШІ TO develop a model for the prediction of total 


maeocurement cost of destroyer type naval ships that 
increases in precision as input data is refined and, 
hopefully, approaches a level of quality acceptable 
in cost-effectiveness studies and eventually for 
imoca leo lanning purposes." 


Their approach was to first correct numerous defi- 
ciencies noted in the RMC study. Because their concern was 
Ex vrediction of total cost rather than the identification 
 басіс contract costs and separate end cost, data was 
aggregated with the basic contract cost data as follows: 


a. Electronic end cost was added to command and control 
cost 
b. Weapons end cost was added to armament cost 


οι τν οὐ end cose was added to construction 
services cost. 
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ney examined three models; a nine-subsystem cost 
model, a four-subsystem cost model and finally a single cost 
estimation equation. The final step was to use the models 
developed to estimate the total procurement cost of a de- 
stroyer type ship under development and compare the predic- 
Bons το the best available NAVSHIPS estimate. 

νιν ивей ас а primary criteria for comparing 
the prediction values of these models the estimate of total 
cost variance associated with each model. They used two 
, 1415 to estimate total cost variance. The first method 
Was called the summation method. This is the same as the 
treatment used by RMC in their study, i.e., the summation 
of the variance not explained in the individual subsystem 
Chis. Again, this method requires the assumption-that the 
errors of the individual CERs are independent of one another. 
Hernon and McCumber acknowledge the difficulties with this 
ОООО ноп апа use this method to obtain a minimum total 
cost variance that may be attained by utilizing that 
meeercular set of model CERS. 

ime second method of total cost variance estimation 
involves the calculation of a total cost mean square residual 
value (MSR) for each model. The following method was used 
memecalculate this value: 

L 2 
; n (Residual 13)! 
N-M-L 


MSR 


ι η = 


i 


14 





where N is the number of ships 


Mis the number of variables utilized 
in all CERs of the model 


ο ο. mumber sof CEHs utilized in 
the model 


Essentially, the residual values produced for each CER for 
a given ship are summed producing an aggregate of the indi- 
aval CHR residual values. The total cost residuals are 
squared and summed for all observations (ships). If this 
quantity is then corrected for degrees of freedom, an esti- 
mate of variance is produced for a given model. Hernon and 
MeCumber considered the MSR method to produce an upper bound 
on the total cost variance estimate, a value below which 
the estimate of total cost variance is expected to lie. 
Hernon and McCumber did not report prediction inter- 
vals in their paper. Their treatment of total cost variance 
memo, permit utilization of the standard linear least 
Ens methodology for handling prediction intervals. The 
Secificient of determination which they reported was the 
Same as the one which the RMC study used and ís subject to 
the comments made earlier concerning it. 

3. RAND Report, "Confidence in Estimated Airframe Costs: 
Assessment in Ageregate Predictions , F.S. Timson 
NINA 
This report addresses the general problem of confi- 

dence measures for multi-equation prediction models utilizing 
in the development specific results from airframe cost esti- 


mation. тре report describes how prediction intervals can 


15 





be calculated for sums of component regressions. The re- 
gressions can be treated as independent and either Student 
t or normal statistics used (the same treatment as the RMC 
study), or the regressions can be treated as correlated and 
Bormal statistics used. 

A simple method permits the determination of the 
degree of correlation between the individual regressions. 
It is assumed that there exists a correlated normal distri- 
bution for total costs. Consider two regressions derived 
from a common data base consisting of the same number of 
observations. Assume the error terms of the two regressions 


are distributed bivariate normal with zero mean then 


(£11; 6,2) We οἱ 
G : G 
le 1 T2 
Q з 2 
721 ^72. 


where i refers to the observation number and 2 is the 


variance-covariance matrix. 


РЕП ІТ? p is the correlation between £.. and £., Over all 


6 ner ie 
Observations ọp = —. p may be estimated from the 
2 
sample as 
А | (Yay Yii/(Yio Yio) 
"NE SED S 
Í τ A Sem 
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When cost models are significantly correlated a 
method for treating the situation is described. This method 
assumes normality as a reasonably good approximation to 
ος probability distribution. The true variance, 


WS of the sum of normal costs is expressed as 


-1 
= И (ут 
W : » TE (1 + X οἱ ἆ X) Χρ) 


where Xo is a specified set of values of 
the independent variables 


X is an observed n x K matrix of 
rank K consisting of values 
taken by K expianatory variables 


.. is the covariance between 
1) models i and | 
лл лрргоОхтшагтоп τοῦ unten is 


the sums of products of the 
residuals of models i and j 
over N observations for 
observation q. 


Prediction interval bounds for the aggregate cost are thus 


approximated at some confidence level a by 


^^ E 
t t 
Co + №(о)\ E x s, (1 + Xo бере Χρ) 


шеше πε wpredicted total cost, js the sum 
of the individual predicted costs of the 
subsystems. 


ΤΙ 





In comparing prediction interval widths for the airframe 

cost model for independent normal and correlated normal 
assumptions at a fixed level of confidence, correlated normal 
distributions generally give the widest intervals. 

It should be noted that in this formulation each 
subsystem CER uses exactly the same explanatory variables 
putting a very limiting constraint on the use of this method 
in multi-equation prediction models. In Naval ship cost 
models it is highly probable that there do exist correlations 
between subsystem CERs. The CERs developed in the RMC 
study and by Hernon and McCumber involve different explana- 
tory variables in the subsystem CERs, hence the above des- 
cribed technique may not be applied. The Joint Generalized 
Least Squares Estimation Technique is a method which will 
produce more accurate results than the least squares (inde- 
pendence) technique under the circumstances of correlated 


residuals and different explanatory variables. 


ΤΕ OBJECTIVES 

The objectives of the thesis are twofold: 

1. То apply the method of joint generalized least 
squares to the ship cost problen. 

ee ebevelop computer routines to carry out the calcula- 
tions associated with the joint generalized least squares 


estimation technique. 


18 





TTI. METHODOLOGY OF JOINT GENERALIZED 
LEAST SQUARES ESTIMATION 

ШЕШТІ @eneralized least squares is a method for taking 
into consideration information that may be available when 
one is interested in the combination of several linear rela- 
tions which are related either because their coefficients 
are partly the same or because their disturbances are 
correlated. In the latter case one can say that the vari- 
Mes that are neglected in the various equations are partly 
EIE е or av least correlated. The statistic used to 
measure the correlation between relations or subsystem 


errors is 


^ A (Уу уу) 
D ox ue. on 
| (Y, =Y, J) E (Yo Yo) 


ав was defined earlier in the RAND study on uncertainty in 


r I rate predictions. 


A. MODEL AND ASSUMPTIONS 

A complete development of the Joint Generalized Least 
Squares Method is contained in Theil [Ref. 7]. In using the 
joint generalized least squares method it is desired to 
formulate the estimates of the parameter vectors of several 
Subsystem equations simultaneously. Suppose there are L 


y 


donations cof the form 


TE 





ο... ee 
y ¿Bj * Є) J > 


where У } і5 а column vector of n observations 


КОЮШ oman X Ka matrix of values taken 
J by the Ks explanatory variables of 
the jth Subsystem relation 


B. is the corresponding parameter vector 
J to be estimated 


є; is a disturbance vector 
Suppose also that each of these L subsystem equations meets 
the assumptions of the standard linear regression model. It 


EN rcd to combine the L equations in the following form: 





СП (пе joint generalized least squares formulation becomes: 


Y = XB + сє 


ШЕ ОО СОЛО 5 ior Joint Generalized Least Squares 
a. The standard linear model holds for all of the 


mecupsystem relations under consideration. 
b. The disturbances of each subsystem equation are 


homescedastic and uncorrelated, 


20 





εν. ο τισ. A 
(EsEs ) Jj j 3 3 


wnere 9 44 is the variance of the disturbance 


vector” ol the jth equation. 


C. Disturbances of different observations but of 
5.8 linear relation are assumed to be zero, 


ЕСЕ = 0 ШЫ 


A ONE 
aJ nJ 


d. With respect to the covariance matrix of the 


Gisturbances of two different equations: 


Е(е1,61,) Е(е),62)) ElE15€n2? 
E(e,,e],) E(E55€5¢) E(e5; eng) 
! = 
Е(е,е, ) 


The diagonal elements are contemporaneous covariances of the 


Porm com ο) and are assumed to be constant in the sense of 


J 
being independent of a. These will be denoted by σερ" 


off diagonal elements correspond to different observations 


The 


and are assumed to be zero: 


Е (єў епа) = 0 α ÉZ n 
J 
Note we obtain 
! 
Е(е,е, T 


2] 





which includes Bleje) = I as a special case. 


(o) E 
Jd 
Ehe disturbances of the L linear relations for the same 
observation are random drawings from a multivariate popula- 


τ 1η zero mean and constant covariance matrix. Thus 





the covariance of the complete vectore is: 
San ο. 
0221 : PR 
VAR(E) = ° ў = ha I 
επ ΣΙ. 
where È = lo 54 
Isi x L matrix X is the covariance matrix of [6,3 D Ear 


Шеш апу о. 
The complete B vector may now be estimated by generalized 
least squares. The Aitken estimator for 8 is, 


^ 


A -."ρι 


tthe Ersneckerproeauet.of the m x n matrix A and the 


EE Cg matrix B is defined as the mp x nq matrix 





For further properties of the Kronecker product see [Ref. 7, 


Е/ 2051. 


“2 





memewhich the covariance matrix is, 


VAR(8) = [x'(z^4 E Dan 


Since 2 15 usually unknown, it is estimated by the matrix 


of mean squares and products of the least squares residuals. 


where E is the least 


Squares residual vector 


of the j th equation and 


nis the number of 


observations. 


Replacing £ with S we obtain the joint generalized least 


squares estimate of the parameter vector В 


b, = [x'(s" ^ n I)X] x'(ts^^ m my 
with the estimator for the covariance matrix 
E t =} тЇ 
VAR(D 5) = [X'(S a I)X] 


Thus we have the essential information to carry out the 


joint generalized least squares estimation technique. 


B. TOTAL COST VARIANCE 


Consider the estimator for X: 


= 
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Aucestimate for total cost variance may be obtained by taking 
the summation of all the elements of S 
ugue cct sT where i is a column vector 
of L ones 
This estimate will be used in the analysis of the ship cost 


problem. 


ο. PREDICTION INTERVALS 


ieee redacuion Intervals Utilizing Joint 
Generalized Least Squares 


A method for determining a prediction interval 
utilizing joint generalized least squares may be developed. 
test be assumed that the disturbances of the L linear 
ea Tons Lor the same observation are random drawings from 
peor variate normal distribution with zero mean vector and 
 Сопесапс covariance matrix. Let C = Σ Y; where C is 
ШЕСІ cost; then τ 


E ο 
πον 


where X, is a row of explanatory variables 


ο οσο. for the L subsystem relations 


^ L ^ ^ ^ 
Now if C^» E z where C and E are predicted costs, then 
ШЕП 
БАЛТАЛЫ Б); VABUD Age. 
ү #585 > ( #3852) 
Therefore 


C-CA/N(O, i'Zi + VAR(E X,,8.)) 


2! 





If the estimates utilizing the sample observations are 
WE for j'»i and Бу» the joint generalized least squares 


estimate vector, for 8, a prediction interval may be derived 


% ! q 
+ • 
Ci Nao) 1'51 + Xy VAR(b,)Xy 


2. Prediction Intervals for Correlated Subsystems 


' να east oquares Estimation Techniques 


ματς possible to provide prediction intervals by 


as 


Single equation least squares estimation technique under the 
circumstances of correlated residuals and different explana- 
tory variables for each subsystem. When substantial corre- 
lations exist between subsystems in the model the below 
aescribed methodology can be expected to give more accurate 
ο πο about uncertainty in aggregate cost predictions 
than would the normal practice of disregarding the correla- 
ee and without utilizing simultaneous estimates. 

An estimated covariance matrix of the least squares 
Emates of the coefficients is obtained as will now be 


described. Consider the L subsystem equations of the form 


Ba cmultiply the sampling error of the least squares 


estimator, fg 


33 оГ B; by the- transpcse oi the sampling error 


er the estimator, ZE Of Ву. Then the covariance matrix 


mor selections i and j may be described as 
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E = ' = t t al 
EL(B, -8,)(8,;-8,)] = 94, OG X4) X1X, (1X) 


where O15 is the contemporaneous 
covariance, 


Х 


р 42 Ф е Ф 
12 3 are observation matrices 


(8. - 81) are sampling errors. 


ШЕШЕ гезпіс will hold if all of the assumptions concerning 
disturbances that were made for the joint generalized least 
Squares method are accepted. These assumptions are much 
less restrictive than those of the least squares (independence) 
mechod. 

Utilizing this concept the covariance matrices for 
all combinations of subsystem selections may be determined. 


The estimates for o for all subsystems are contained in 


ΠῚ 
che matrix of mean squares and products of the residuals. 
Letting Es = Е[(8, -8,)(8,-8,)] a covariance matrix, denoted 
VAR(g), similar to the covariance matrix of the joint esti- 


mates may be constructed in the form shown below 


ЕН Πλ... ь 
ШЕН Е-Е, 

Бүз : 
Е Е Е 


iy Jo . LL 
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If it is assumed that the disturbances of the L 
linear relations for the same observation are random drawings 
from a multivariate normal distribution with zero mean vector 
and a constant covariance matrix, a method for determining 
asprediction interval may be developed paralleling the 
prediction interval method utilizing joint generalized least 


GS estimates. The resulting prediction interval 


πο. \ /i'Si + X,VAR(B) Xt 


where С is estimate of total cost 


becomes 


ΘΝ VvecCtCOr OI explanatory 
variables [Χχη»»»Χχγ} for the 


L subsystem relations 


VAR(B) is the covariance matrix of the 


least squares estimates. 


E 





IV. DATA BASE 


τε аге three subsets of the data base that require 
eS sion; contractor bid cost data, end cost data, and the 
independent variables. Contractor bid data was used for 
predicting subsystem costs. This was a compromise, the 
reason for which was that bid cost data was the most meaning- 
ful data available for the period under study (1954-1966). 
Cost accounting systems differed greatly among the various 
contractors and NAVSHIPS, making it impossible to obtain 
Gata on a uniform level of aggregation from any other 
sources. Bid prices themselves are subject to fluctuations 
due to factors in the shipbuilding industry such as overhead 
distribution, workload, level of expertise at a particular 
ου. ονὰ- The source of the bid data was the file of 
NAVSHIPS Form 4282.2, UNIT PRICE ANALYSIS-BASIC CONSTRUCTION, 
ШӘРІП lists contractor estimates for the nine different con- 
ОСОП cost groups, subdivided into three categories; 
direct labor, direct material and overhead costs. The 
г. ο eenacOsusdava was thew NAVSHIPS records of Ship- 
building and Conversion, Navy (SCN) fund. There are forty- 
one physical and performance characteristics for each ship 
πο are contained in the RMC data base. These character- 
istics are essentially design parameters such as maximum 
Speed, maximum draft, hull, propulsion weights, etc. They 
are utilized as candidates for independent variables in the 


models developed. Reference 4 and reference 6 give more 
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Саса descriptions of the entire data base. Appendix A 
gives a description of Ship's Characteristics used as ex- 
Dime tory variables. Appendix B gives a description of 


Wee contract cost categories. 


A. DATA ADJUSTMENTS 
EX Bid Cost Data 

Contractor raw bid data was adjusted in four specific 
K LO remove cost variations due to factors other than 
uw Characteristics as follows: 

a. Learning effect - when the cost of ship construc- 
tion decreases progressively with each ship in a procurement 
νο. 

b. Temporal effect - which takes into consideration 
variations of prices, productivity and wage overtime. 1965 
ENSE SS were used. 

c. Installation of government furnished equipment. 

d. Cost of plans from external sources. 

The order of adjustment was as follows: 
(1) Application of learning curves. 
(2) Adjustments using 1965 indices. 
(3) Addition of the cost of GFE and plans. 
Details of these adjustments are found in Ref. 4 and Ref. 6. 
2. End Cost Data 

End cost data was adjusted in much the same way that 

contractor bid data was adjusted. Three specific adjustments 


were made to the raw end cost data. 
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a. Treatment for learning effect. 
b. Adjustment for temporal effect using 1965 indices. 
ο. An adjustment for nuclear technology with propul- 
SU one OST S. 
Шега115 ОГ these adjustments are found in Ref. 4 and Ref. 6. 
The data base is published separately as APPENDIX H of Ref. 


Ш апа із a CONFIDENTIAL document. 


fee DATA BASE STRATIFICATION AND COST GROUP MODELS 

Hernon and McCumber noted that some DLG type ships had 
meet tcanvly higher costs in the areas of hull, outfitting, 
ponstruetion services, weapons end cost, and electronics 
end cost. Іп addition the DLG ship was considered to have 
a different operational mission than the smaller, less 
expensive destroyer type ships. Thus, two basic data base 
Seravification levels were examined: 

1. General Data Base: DD/DDG/DE/DEG/DLG (36 Ships) 

2. Escort Data Base : DD/DDG/DE/DEG Санав» 

Using both of the data bases, CERS were developed using 
evo different methods of cost sns ος schemes which 
are examined in this paper. The coding system as developed 
by Hernon and McCumber is contained in Table I and will be 


used for easy reference. 
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TABLE I 


DATA BASE STRATIFICATION LEVELS AND COST GROUP MODELS 


MODELS B/C - 9 COST GROUP CERS 
mull Cost 

meopulsion Cost 

moe trical Cost 


Communication & Control + Electronics 
End Costs 


Auxiliary Cost 

u (iLting Cost 

Armament + Weapons End Costs 
Design & Engineering Cost 


Construction Services + Miscellaneous 
End Costs 


MODELS D/E - 4 COST GROUP CER 


Base Cost = Hull + Outfitting 


Engineering Cost = Propulsion + Electrical 


me Auxiliary 


Payload Cost = C & C + Armament 
+ Electronics End Cost + Weapons 
End Cost 


Memsceruction Cost = D & E + Construction 


services + Miscellaneous End Cost 


S 


CER CODE 
General Escort 
Level Level 
B-1 C-1 
B-2 C-2 
B-3 C-3 
B-4 c-4 
B-5 C-5 
B-6 C-6 
B-7 C-7 
БЕС Gao 
B-9 C-9 
D-1 E-1 
D-2 E-2 
D-3 E-3 
D=4 E-4 





V. ANALYSIS 


Whe General scheme of analysis was to apply the joint 
generalized least squares method as has been developed to 
the ship cost problem. In doing so computer routines were 
developed to carry out the indicated calculations associated 
with joint generalized least squares. Computer routines 
were also developed to solve the problem utilizing the least 
squares method in order to compare the results of the two 
methods and more clearly determine the nature of gains by 


using the joint generalized least squares method. 


A. GENERAL COMMENTS 
computer Programs 

A computer program was developed in order to perform 
the joint generalized least squares analysis. Essentially, 
EE Ua set is read in and then transformations to the data 
as programmed are conducted. The program then does the 
number of standard multiple linear regressions required (one 
for each subsystem CER). The residuals from the single 
regressions are saved and utilized to compute a matrix of 
correlations between selections. Next the program does the 
joints generalized least squares calculations; initially S 
is computed from the least squares residuals, next δι» ee 
Ee cer estimate vector is computed along with the co- 
variance matrix Vib). Finally, the joint generalized 


least squares prediction interval values are calculated. 


Dc 





Details of the program and a users manual are contained in 
APPENDIX D. The program was designed to be easy to use for 
analysis utilizing the joint generalized least squéres method. 
Double precision was used to improve accuracy by reducing 
ШІПСОГТ errors. The program will handle up to thirty-six 
observations and nine subsystem relations. Each subsystem 
relation may have up to four explanatory variables (including 
the constant term). It should be noted that larger dimensioned 
problems may be possible but computer capacity becomes a 
Benstraint to be concerned with. 

A computer program was also developed to perform 
the calculations required to compute a least squares predic- 
tion interval assuming independence between subsystem CERs. 
Mereentially a data set is read in and then transformations 
ου το Gata as programed are conducted. The program then 
does the number of standard multiple linear regressions 
required (one for each subsystem CER). Then the information 
required from each individual regression is used in the 
eleulation of the prediction interval. ' This computer pro- 
gram is provided in Appendix D. 

Finally, a computer program was developed to perform 
the calculations required to compute a least squares predic- 
tion interval assuming correlated disturbances between sub- 
system CERs. Essentially, a data set 2 read in and trans- 
formations as programed performed. Next the covariance 


matrix of the least squares estimates as described in 
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ο ουσ τσ sc iS constructed. Finally the calculations 
Eee Carried out to compute least squares correlated predic- 
Peon interval values. This computer program is provided 
in Appendix D. 
ο ουσια 

ΙΤΕΠ lemer celta used Lor evaluating the joint 
generalized least squares method were the reduction in the 
@evariance matrix of the estimate, the prediction intervals 
computed and the mean square residual values obtained from 
each observation. The first, a comparison of the diagonal 
elements of the estimated covariance matrix of the joint 
estimates and the estimated covariance matrix of the least 
Squares estimates gives an impression of the gain obtained 
by applying the joint generalized least squares method 
rather than the least squares method. The second, the pre- 
diction intervals computed, gives the effect of the assumption 
of independent subsystem CER disturbances as compared to 
the assumption of correlated subsystem CER disturbances, 
and also a feel for the effect of using the joint generalized 
least squares estimation technique. In the third, mean 
squared residual values (MSR) are obtained from each obser- 
vation, as the difference between observed and total cost. 
When these total cost residuals are squared, summed for all 


observations (ships), and corrected for the number of 





Швегтайсіопв, a statistice is obtained for comparison of a 


set of αι S 


3. Heteroscedasticity 

Hernon and McCumber used a log linear model for 
weir propulsion and engineering CERs in their nine CER 
group model and four CER group model respectively. This was 
done in order to correct for heteroscedasticity encountered 
with the linear model. The joint generalized least squares 
method will not allow calculation of prediction intervals 
when individual CERs are of mixed linear and log linear form, 
therefore, an alternate method was used to correct for 
heteroscedasticity in these relationships. 

Consider the relation ος Bo τ ВУХ ч Í ες rer 
ЖЕ 1,...,П1 where m is a random disturbance witnh zero 
Peepectation. If it is assumed that the disturbance variance 
is proportional to the square of the independent variable 


2 а 


chen E. 7 KX 1] Гог а = 1,...,п апа for some positive constant 


“Reference is made to mean squared residual (MSR) values 
νυν contexts in this paper. MSR values refer to the sum 
of the squared total cost residuals for each observation 
divided by the number of observations. MSR values adjusted 
for degrees of freedom refer to the sum of the squared total 
cost residuals for each observation divided by the number of 
observations minus the number of parameters estimated minus 
meeenumber of CERs utilized in the model. The first is a 
statistic for comparison between models, where as the second 
is an upper bound estimate on total cost variance as de- 
scribed by Hernon and McCumber [Ref. 4]. 
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k. Dividing the values of the a observation by Хо і5 
thus equivalent to the following reformulation: 
y B ε 
Кв + 
al al ol 
The disturbances Ε1/Χη1 — ИХ have a scalar covariance 


matrix (kI) under the formulation so that the assumptions of 
the standard linear model are now satisfied. Scatter plots 
of residuals versus independent explanatory variables were 
used to determine the variable causing the heteroscedasticity 
in each relation and the above described reformulation was 
EE-d to correct for it. A full description of the method is 
Bound in Theil [Ref. 7]. 
4. Number of Observations 

Hernon and McCumber conducted an analysis of resid- 
uals to verify the normality assumption of the least squares 
Espression technique and to identify any significant outliers. 
This resulted in the deletion of outliers in the development 
of several subsystem CERs. This causéd the observations of 
articular ship to be used to calculate some subsystem 
CERs, while not being used in others. Joint generalized 
least squares requires the same number of observations for 
meeesubsystem relations. Therefore, all observations were 
used in the joint generalized least squares analysis. In 
Appendix B of Ref. 4 Hernon and McCumber report the CERs 
developed including outliers in the data base. For purposes 


of comparison with joint generalized least squares results 
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these CERs were used instead of the CERs developed by the 
ОССО СИС ете Та и5 the general data base has thirty- 
six observations (ships) and the escort data base has twenty- 


seven observations. 


bee COs! GROUP CER MODELS ANALYSIS 

ος τις Cesuugroup CER model consists of CERS as indi- 
Саса and coded in Taste 1. The regression strategy used 
in the development of these CERs along with a discussion of 
Ше results is found in Ref. 4. It was necessary to use a 
Seale factor of 1/100 for the variables ENGPAY, PWRLD, 
ELEWGT, C&CWGT, PRAXWT, LSW, ARMWGT and PROLSW (the weight 
variables used) to enable inversion of the matrices required 
in calculating the joint generalized least squares estimates. 
These factors are reflected in the computer output in Appen- 
dix C for the mine group CER models, but have been removed 
ШІ the results reported in this section. 

The four cost group CER model consists also of CERs as 
indicated and coded in Table 1. No scale factor was re- 
Quired. In deriving the O der an attempt was 
B de to make the subsystem categories as independent as 
possible, first with respect to the nature of ship design, 
and secondly with respect to the differences reported earlier 
трата тала contractor accounting practices. Details 
of the regression strategy and development of the subsystem 


CERs are contained in Hernon and McCumber,[Ref. 4]. 
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io есп ув 

The following tables present four different sets of 
CERs ~ one set for each of the two models employing the 
general data base, and one set for each of the same two 
models employing the reduced escort data base. Following 
each set of CERs are tables containing correlations between 
selections for that particular model and selective comparisons 
of covariance matrices of the least squares and the joint 
generalized least squares estimates. The complete covariance 


matrices are contained in Appendix C, computer output. 
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TABLE IV 
BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 


MODEL B - 9 CERs - GENERAL DATA BASE 


JGLS LS 
HULL 
.12930-01 -.3523D-02 .7392D-01 -.3578D-02 
.1960D-03 .1991D-03 
PROPULSION 
.1244D 02 -.1994D 01 .1330D-03 | .1499D 02 -.2270D 01  .129HD-03 
‚5012D 00 -.5009D-04 .5734D 00 -.5755D-04 
.6428р-08 .7885р-08 
ELECTRICAL 
.3025D-01 -.1964D-02 -.7572D-02 | .3377D-01 -.1597D-03 -.9330D-02 
.7613D-02 -.2417D-02 .9372D-02 -.3647D-02 
. 3206D-02 .4214D-02 
COMMUNICATION AND CONTROL 
.2177D 01 -.1032D 01 -.4362D 00 | .2381D 01 -.1112D 01 -.7143D 00 
.6008D 00  .9698D-01 .6H05D 00 .1518р 00 
ο ο. οἱ .1839D 01 
AUXILIARY 
.6227р-01 -.5399D-02 .6439D-01 -.5612D-02 
.5425р-03 .5639D-03 
OUTFITTING 
.1808р-01  -.4824D-03 .1978D-01 -.5352D-03 
.1510D-04 .1675D-04 
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JGLS 
HULL . 
4421D-01 -.2579D-02 
.17130D--03 
PROPULSION 
.5893D 01 -.5540D 00 
.6322D-01 
ELECTRICAL 
.2340D-01 -.1152D-01 
.2160D-01 


TABLE VII 


BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL C - 9 CERs - ESCORT BASE 


=. 313 /D-02 
–.3461р-02 
.2137D-02 


COMMUNICATION AND CONTROL 


.3781D 01 -.2604D 01 
ο ΠΠ 0l 

AUXILIARY 

.8039D-01 -.8081D-02 
ΠΠ 

OUTFITTING 


.2786D-01 -.1039D-03 
. 4208D-06 


.5018D 00 
-.8792D 00 
.1436D 01 


ДЦ 


LS 


.4831р-01 -.2850D-02 


.1894D-03 

.7706D 01 -.7609D 00 
. 8684D-01 

.2498D-01 -.1232D-01 
.2770D-01 

.ll243D O1 -.3150D 01 
. 3007D 01 

.9440p-01 -.9740D-02. 
| .1154D-02 
.3586D-01 -.1363D-03 
.5520D-06 


"SIRE 
—.5219D-02 
.2/92D-02 


.1083D 01 
—-.1932D 01 
ΕΙΡ 





uoTI0NAISUu0D 0-1 


peorÁed 556° Drs | 
ZUTISSUTZUN Die 680” ΠΠ 

aseg ςς0”- ОТТ Th OR 

Suo? Кед *UTBUT 9seg 





ЧЅҮЯ VIVO 'IVHUNHO - 58442 қ - а THCOW | 
SNOILOXIdS NJAMI SNOILV'IJHHOO HO XIULVN 


[MASIOHd] £8100* + [LOMINH] 0FS00° + 70897- = 3800 

[MSTOHd] 102007 + [LOMINH] SSS00° + OFTO°T- = 1500 | DOS onc 109 
НЕСІ ОГ! ЗЕ ССОО 6506 9- = 2509 
[dNS-SW] 149979 - [MST] S8S00° + 1981°9- = 3500 % peoTAta 
[LOMONE) Sele’ + [ATHMd] 62900° + 8H)S’- = 3500 
[LIMON] #99¢° + [ATYMd] 22500° + STS9°- = 3500 ‚ZUTIISUTZUF 


ГМСТ1 ТІТ00" ғ 6,66" = 2809 
[MS'1] STTOO* + 904° = 29809 әсея 


dido AHODHLVO-HüS LSOO;COHLYW [4d00 


aSVd VLVd IVYHNEDS - SHAD WHLSASAGNS һр - Аа THCOWN  :IIIA W'ISVIL 








45 





JGLS 
BASE D-1 
.1197D 00 -.3214D-04 
.1006D-07 


ENGINEERING D-2 


.1539D-06 -.1136D-04 
ΤΙ) 05 

PAYLOAD D-3 

ES081D 01 -.1726D-02 
.7672D-06 


CONSTRUCTION D-4 
. 7868D 00 -.4696D-03 


. 3680D-06 


TABLE IX 


BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL D - 4 CERs - GENERAL DATA BASE 


.9565D-05 


-.9690D-02 


.1022D 00 


.1422D 01 


-.1004D-02 


.2470D Ol 


. 7886D-06 


–.2255р-07 


. 3930D-07 
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JGLS 
BASE E-1 
.1056D 00 -.3761D-0! 
.1456D-07 


ENGINEERING Е-2 


.1479D-02 -.1452D-01 
.1657D 00 

PAYLOAD E-3 

.1052D 02 -.4401D-02 
.2065D-05 


CONSTRUCTION E-4 
.2226D 01 -.1993D-02 


.1932D-05 


TABLE XI 


BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL E - ! CERs - ESCORT DATA BASE 


.3108D 01 
-.1943D-02 
.3970D 01 


-.5692D-04 
. 3906D-08 
.8972D-07 
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.1108D 00 


πο OT 


‚11720092 


LS 


-.3962D-04 


.15330-07 


-.1513D-01 


.1727D 00 


-.5108D-02 


.2472D-05 


.2374D 01 -.2120D-02 


.2050D-05 


.42550 01 
–.2658р-02 


.5429р 01 


- .8667D-04 
.1330D-07 


.1238р-06 





The following table indicates correlations of greater 


man = .4 for the four models: 


ΠΤΙ, ἘΠῚ 
MODEL CORRELATION SUBSYSTEMS 
B | You Outfitting and Propulsion 
- „105 Outfitting and C&C + 
Electrical 
„402 ПӘНЕСОПОТТОП and C&O Ft 
Electrical 
C ~ ,449 Auxiliary and Propulsion 
е 1119 ОШОГО Л р апа Hurl 
- 20 ӘЙ БІНЕ ата Стат 
Electrical 
Sou Censtruetion anazEzt + 
Electrical 
D EHE Y | Engineering and Base 
53 construction and Payload 
E .490 . Construction and Payload 


C correlation estimates do indicate significant degrees 
of correlation E cL subsystem CERs and would tend to 
provide evidence against a hypothesis of independence 
between subsystem CERs. 

The block diagonal covariance matrix comparisons 
show a reduction in the variance (diagonal) elements in all 
cases and a reduction in the covariance (off-diagonal) ele- 
ments in the large majority of cases by the joint generalized 
least squares estimates as compared with the least squares 


estimates. This may be attributed to the fact that the joint 
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generalized least squares method takes into consideration 
the correlated subsystem disturbances in computing the 
joint estimates whereas the least squares method computes 
the individual subsystem estimates separately. 
Tobal Cose Variance 

Total cost variance for each model was computed 
utilizing three methods. The first method was to take the 
Summation of the individual subsystem CER standard errors 
assuming independent subsystems. The second method was to 
make the summation of the entries in the Š matrix of mean 
squares and products of all sets of subsystem CER residuals, 
the estimate for 2. The third estimate was obtained by 
Summing the residual values produced by each CER for a given 
ship which gives the difference between observed and predic- 
tea cost for that ship as an aggregate of the individual CER 
values. The total cost residuals are then squared and summed 
for all observations (ships) and divided by the degrees of 
freedom, defined as the number of observations minus the 
number of parameters estimated minus the number of subsystem 
CERs, to obtain the mean squared residual value (MSR). This 
method was used by Hernon and McCumber [Ref. 4] to form ап 
upper bound on total cost variance. In essence, the summation 
method assuming independence provides a lower bound on total 
cost variance. The summation of the S matrix elements (S 
matrix summation), assuming correlated subsystems provides 
a midrange, more realistic estimate, between the upper bound 


(MSR method) and lower bound (LS Summation method). The 
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Values for these three methods are contained in the following 


table: 
111 
METHOD 

MODEL ΠΠ, (S MATRIX SUMMATION) (MSR) 
B 19.64 123.9 163.0 
С ΠΟ, Ἡ- 58.38 526.0 
D τ ο 36.54 58.3 
E το oum 43.6 


s prediction Interval and Predicted Costs 

Three prediction intervals were obtained for each 
model in the manner described in Section III.C, e.g., least 
EuuSres with independence, least squares with correlations 
and joint generalized least squares with correlations. 
The estimated total ship cost was computed with the least 
Squares estimates in the first two cases and the joint esti- 
ο in the third. The results are summarized im Ge 
following tables. There is a table for each model which 
contains the prediction interval length for each observation 
ру each method. Also contained in each table are the abso- 
lute differences between actual and estimated cost obtained 
by using the least squares estimates and the joint estimates. 
The actual prediction intervals are contained in Appendix C. 


The signs of the value of the differences between actual 
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TABLE XIV 


MODEL B: PREDICTION INTERVAL SUMMARY 


OBS LENGTH LENGTH LENGTH AN ES | A| JGLS 
LS( IND) JGLS LS (CORR) ACTUAL- ACTUAL- 
ESTIMATED ESTIMATED 


1 24.64 28.76 29.19 10.99 11.69 

2 24.23 28.54 29.10 3.47 4.33 

3 24.28 255 28.82 S 4.62 

Ц 23.02 A | 20550 4.09 3.98 
D ei 20542 2915 1.92 220) 
6 287529 l DOE 1.89 ο ο 
í а 20211 29.15 es С 
8 2339 ΝΕ 20. 15 2.84 SES 
9 23.38 20.12 аве το» TIS 
10 5 POENIS 28.15 Ou BS 5.17 
71 со DONE pou 9.94 9.60 
174 23439 28.12 ο. 3.70 4.04 
ШІ 2 20.12 5.15 4.83 5.04 
14 ων οι ZU 2 28.14 8.36 0.50 
19 23.97 28.85 20.02 .46 Шыда 
16 23.78 28.74 28.81 2:80 el] 
1 23.78 28.78 28,84 ο 258 
18 εν το 28.74 28.81 30 110 2.99 
19 24.07 29.12 2096 Eb 2554 
20 23.89 28.99 29.08 3.93 DNE 
21 23.84 28.84 29.04 Ε 5 2.26 
er 23. [0 26551 28.72 1.49 Jo O 
23 23.34 Омо 28.34 3.43 3.00 
28 Ban DONT 28.34 24.15 24.30 
25 29236 28.29 ο Ὁ 1.08 5 
26 24,22 РОО LES eS 1-53 
27 23.79 28.48 ас ον 4.81 H.22 
28 LCD 28.34 28.40 КЕП 18.39 
29 ο 28.34 28.40 D 2.99 
30 24.56 29.44 29.59 18.28 19.39 
EL 21712 28.99 E ES 0.45 lee? 
3 20.05 28.69 29291 DT 4.76 
bo аа СБ 28.69 20301 ор 1.10 
34 24.48 29.16 29.60 10.82 15.55 
30 2 ο. 28.83 28.93 „20 2 5 
36 25772 28.84 20025 ο οἳ Seog 
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ПЕШО 


MODEL C: PREDICTION INTERVAL SUMMARY 


OBS LENGTH LENGTH LENGTH ГІН Ше |A|JGLS 
LS (IND) JGLS LS(CORR) ACTUAL- ACTUAL- 
ESTIMATED ESTIMATED 

il 22.02 DENS 23.90 6.96 8.0 

2 29,73 PEINT 23.56 2.02 ата 

3 с © 23.17 23.57 2.19 2.93 

Ц а 25702 5 10.58 10.05 

5 20.92 22.88 22.98 1.89 a 

6 20.92 20502 22.95 ПОВ 1.59 

7 20.91 O 22.95 4.32 4.10 

8 202.92 2.5 22.95 .89 „64 

9 20.92 pom 22.98 3.9 PIER 
10 20.92 2200 22.95 ibo dt ПСБ 
Пар, 20.92 υπο 22.95 πο ος 13.42 
12 20.92 2ο ο 22.95 .03 52 
ШЕ 20.91 22.86 22.97 2207 149! 
14 20-91 22.88 22.97 4.62 4.86 
15 2 Ὁ ο 5 23.58 ПІ ШЕ ene 
ШО 21.29 23.45 23.56 al .79 
Ισ 20 9 23.45 23.56 .98 1.36 
18 21:20 ' 23.15 23 O . 1.39 кү 
19 21.38 о 106 δι 3.08 PEDE 
20 21 5 23.68 23.79 S 3.48 
21 20.87 ου οὐ © .24 5 
22 21.19 22.97 23.35 1.80 LS 
23 2 зо 23.17 .60 .95 
24 ӘЛЕН 22236 23.17 21.46 ο 
25 ο. ο zen 23.40 3.96 258 
26 ας 23.15 23.38 DNE 3.31 
27 η 93.05 23.2! 5.05 |. 
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TABLE XVI 


MODEL D: PREDICTION INTERVAL SUMMARY 


OBS LENGTH LENGTH LENGTH |A|LS |A| JGLS 
LS( IND) JGLS LS(CORR) ACTUAL- ACTUAL- 
ESTIMATED ESTIMATED 

1 22.49 25.63 ΕΠ 7.33 6.70 
2 со 25.55 25.68 AY ‚33 
3 22.36 25.55 25.68 СТ . 39 
Ц 2 25.38 25.45 7.01 7.30 
5 21.97 22 25.35 .69 43 
6 21.95 25,32 25,35 .39 als 
7 21.93 25.32 25.36 3.02 2.74 
8 a, ТЕУ. 25,35 54 OT 
J 21.99 аст 2595 DS 5.34 
10 21.97 25,31 25.35 2.84 SO 
ІІ ОТ 25531 25,35 ο ορ 11.97 
12 DIET 5-51 25.35 1.40 ШЕТ 
13 21.99 ες 25.33 ӘСЕ 2.86 
14 21.97 a ul 25.34 ο. 6.31 
15 po Ὁ] 25.86 25.90 . 8H 1.05 
16 22.04 25.85 25.88 1.90 1.46 
ШЕТ 22.04 25.85 25.88 2.47 PIE 
18 PIED 25,85 25.88 2.89 2.44 
19 52, Τι 25.82 95.86 9.65 2.88 

20 21.99 25.80 25.82 4.33 3.86 | 
gl 21.88 25.58 25.92 n n 
22 22.04 25,53 25.65 Hy Do 
23 21.93 25.16 ΠΡ .19 .14 
οἱ 21.93 25,46 25.54 20.54 20.57 
25 219.95 25.46 25.55 4.0 3.96 
26 22.00 5.1. 25.58 1.49 1.54 
27 πο 25.142 25.50 4.86 5.20 
28 pag 25.11 25.44 Io її 19.67 
29 22.10 25.41 25.44 F 1.69 
30 23.56 2 ο) 26.52 18.78 19.54 
El 23.82 26.23 26.39 9.08 8.98 
32 23.26 ος 6 26.34 5.74 5.88 
33 23.26 26.16 26.34 2.14 2.28 
34 24.39 27.04 — 10 4.0 OO 
B5 24.09 ON Pr πο. 4.68 
36 24.09 — у η 2.59 2201 
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TABLE XVII 


MODEL E: PREDICTION INTERVAL SUMMARY 


OBS LENGTH LENGTH LENGTH aes | ^| JGLS 
LS(IND) JGLS LS(CORR) ACTUAL- ACTUAL- 
ESTIMATED ESTIMATED 

1 2139 ү 22.03 neo 4.59 

2 Zl NS ΕΠ. 5È O . 88 1.04 

3 2120 51.5 5η. Το . 48 .63 

Ц 20.80 υπ στ 21.59 9.35 5. 91 

5 20.49 РІН 22 21.55 от mo 

6 20.49 21.29 21.33 PAS τος 

7 20.48 аро 21.34 p 3.37 

8 20.47 ο) «ο 21.33 ЕТІН „32 

9 20.49 21.32 21:36 3.39 3.79 
10 20.47 21.29 21.33 1.56 2797 
πι ο 21.29 21.33 13.53 Toon 
12 орт 21.29 21.33 E .53 
13 20.50 21.34 21.36 .90 1.30 
14 20.50 21.34 з 4.54 4.93 
15 20.88 22.05 ze ar 220 
16 20.88 22.04 ο . 18 .20 
17 20.88 22.04 ПОТ .07 237 
18 20.88 290 22. 1 ΘΙ .50 . 78 
19 20.59 21.94 2200 2.52 2.16 
20 20.59 21.92 21.99 3205 4.24 
21 20.13 21.39 21.44 ‚99 1.34 
22 20. 71 21.59 21.80 3.25 2.85 
23 20.44 21.39 21.53 .14 Ly 
24 асан 2138 21.53 Т 2o 
25 20.42 21.38 205.55 2:05 3.20 
26 0 57 21.46 pmo ΕΠΕ 2.47 
27 za 21.34 21.45 πα 4.92 
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and estimated cost for both the least squares and the joint 
generalized least squares estimates are the same in all cases 
and have been dropped in the table for simplification. 
icmp edicten int erval length becomes longer pro- 
gressing from least squares (independent) to joint generalized 
least squares and finally to least squares (correlated). 
Both least squares (correlated) and joint generalized least 
Ssouares provide intervals which are Significantly longer than 
those produced by the least squares (independent) method, 
while the joint generalized least squares method provides 
a small decrease in prediction interval length over the 
least squares (correlated) method. The latter two methods 
represent the prediction interval length more accurately 
assuming that there are correlations between subsystem CERs. 
Both of these methods require approximately the same degree 
eemcompucvational difficulty and thus it would appear that 
the joint generalized least squares technique offers the 
Mest alternative in accurately stating prediction intervals. 
The mean square residual [MSR] value, not adjusted 
for degrees of freedom, was computed for the least squares 
estimates as compared to actual cost as was the same value 
Tor the joint estimates. It was intended to use these values 
as a way of comparing the two methods to see which provided 
Ebest estimates. But further examination led to the con- 
efusion that there is no guarantee in using this technique 


Anat one method will be consistently better than the other. 
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In the joint generalized least squares case with heterosce- 
Gasticity the formulation of the problem is such that the 
ШЕШЕСІ of the residual vector, after a transformation, is 
being minimized. Hence the solution we obtain is for the 


problem: 


Min (Y - X8)(z | Q I)(Y - X8) 


where ο. ΙΙ; Unknown nonsingular 

matrix which is estimated by (S КОО) 
and for which b, = [X' (Sl gy xr ix' (sig DY is the 
joint generalized least squares estimator as deveioped in 
Eton Ill. This estimator, Е in fact does not minimize 
the length of the residual vector. Therefore the MSR method 
will not discriminate between the two methods of estimation 
L nis case. For a complete discussion of this problem see 
uel [Ref. 7]. 


The MSR results are contained in the following table: 


TABLE XVIII ' ' 


MODEL 
B C D E 
LS MSR 40.4 CNN S 49.7 597% 
76,5 МӘК 50.4 5 8 eile 36.2 


In models B, C and D the least squares estimates come out 


ahead whereas in model E the joint estimates come out ahead. 
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The total cost predictions by the least squares 
estimates and the joint estimates are very close when com- 
pared to each other. The Summary Tables present these 
values for comparison. On aworst case basis the differences 
between these two methods for each model, indicating the 


particular observation, are as follows: 


MODEL/OBSERVATION 
B/34 C D/ 36 Е 
SIZE OF DIFFERENCE 1.44 Πο ΠΠ] 1.59 .63 


$/MILLION 


In no ease is this difference greater than three percent 
K Gl estimated cost. 

Шелізт?іпе the additional information available due 
to the correlations between subsystems, joint generalized 
least squares estimates should provide amore accurate 
weighting of the variables in each CER. This is important 
in assessing the contribution to subsystem cost of a 


particular variable. For example, consider the CER B-6: 


.436 + .000386 [LSW] (Least Squares) 


BUMRTTTING COST 


‚549 + .000350 [LSW] (Joint Generalized 
Least Squares) 


UTE TITING COST 


The coefficient of light ship weight (LSW) reflects the 


ШОП ре in outzsieting cost per pound for a change in ight 


ship weight. The joint generalized least squares coefficient 
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should provide a better reflection of the contribution of 


ment ship weight to outfitting cost for this CER. 
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VI. CONCLUSIONS 


It has been demonstrated that the joint generalized 
least squares estimation technique, by taking advantage of 
the additional information which is provided when correla- 
bons exist between the residuals of subsystem CERs in ag- 
gregate cost estimating, provides more accurate and meaning- 
ful statements about predictions, the total cost variance 
EmUrounding the predictions, and the prediction intervals. 
The method involves an increase in computational difficulty 
when compared to one assuming independence between subsystem 
CERs, but gives a more accurate statement concerning the 
estimates and their uncertainty. А computer program has 
been provided which is readily usable in conducting joint 
generalized least squares analysis and the additional time 
required would be minimal. 

The predictions utilizing the joint estimates provide 
gains in amore accurate weighting of the variables in the 
subsystem CERs. This allows a ООО Дл» analysis of 
the ο ο ος to subsystem cost and hence to total cost. 

The estimate for total cost variances used in the joint 
generalized least squares method provide a more meaningful 
Statement taking into consideration the correlated distur- 
bances. The least squares estimate assuming independence 
tends to substantially understate the total cost variance 


ШІ the situation analyzed. 
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D κο оаа оет пай сраз теа utilizing the joint 
ПО асе least squares method represented a slight gain 
er Ghose ODGained Dy the least squares method, assuming 
correlated disturbances. Both these methods provided more 
EscUuPate prediction intervals under the assumptions made; 
however, with equal computational difficulty the joint 
generalized least squares method appears the superior of 
the two. 

lx uonldepecemphassrred that the Joint generalized 
least squares method involves less restrictive assumptions 
than the least squares method. The assumption of correla- 
tions between subsystem CERs is a more reasonable statement 
of the true relationship as was shown by the tables of 
correlations between subsystem CERs. The least squares 
method does in fact tend to understate the uncertainty 
surrounding the cost estimate. Joint generalized least 
Squares by utilizing this additional information gives more 
meaningful results in the derivation of the estimate and 
che statement of uncertainty surrounding the estimate. 

The overall gains achieved by the joint generalized 
least squares method overshadow the small additional cost. 
This application to destroyer type ship models may be extended 
to any other situation where one is interested in aggregate 


predictions of the same nature. 
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10. 


ll. 


APPENDIX A 


DESCRIPTION OF SHIP'S CHARACTERISTICS USED 
AS EXPLANATORY VARIABLES IN THESIS 


Characteristic Symbol 


Light Ship LSW 
Weignt 

Hull Weight HULWGT 
Propulsion PROWGT 
Weight 

Electrical ELEWGT 
Weight 


Communication CHWGT 
and Control wes jt 
Ж 


Auxiliary AUXWGT 
Weight 

Butfitting OUTWGT 
Weight 

Armament ARNWGT 
Weight 

Complement COMP 


Maximum Shaft MAXSHP 
Horsepower 


Range RANGE 


Units 


long tons 


long tons 


long tons 


long tons 


long tons 


long tons 


long tons 


long tons 


integer 


nautical 
miles 


Бе таео 


Weight of ship complete with 
all items of outfit, equip- 
ment, and machinery but 
excluding cargo, stores, crew, 
etc. Includes lead ballast 
for surface ships but not 

for submarines. 


These are the weights of the 
seven groups as described in 
Bureau of Ships Consolidated 
Index of Drawings, Materials, 
and Services Related to 


Construction Conversion. 


Allowance for all officers 


апа men on board. 


Total power that can be applied 
continuously to the shafts 
under designed operating 
conditions. For subs this 
applies to surface operation. 





12. 


13. 
11. 
ШЕ). 


16. 


17. 


ΠΟ. 


ШЕ) 


20. 


21. 


Characteristic 


Series 


DE or DEG 


Prototype Dummy 


Number of 
Generators 


Power Loading 
Factor 


Award Date 


Generator 
Capacity 


Propulsion and 
Auxiliary 
Weight 


Prototype 
Light Ship 
Weight 


Missile End 
Dummy 


Symbol 
SERIES 


DEDEG 
PROTO 


NO-GEN 


PWRLD 
AWARD 


TKWCPY 


PRAXWT 


PROLSW 


MS-END 


Units 


integer 


integer 
integer 


integer 


years 


kilowatts 


long tons 


integer 
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DEMI IONS 


A number that represents 
the positron. ol a ship in 
a series of similar ships. 
For example, DD 936 to 

DDG 30 have the same basic 
design except for missiles 
and constitute a series of 
39 similar ships. DD 936 
would be assigned series 
number 1 and DDG 30 would 
be assigned series number 


39. 
{| 


ГЕ ог DEG; zero otherwise. 


1 = protytype; zero otherwise. 
Number of ship service 
generators 


Ratio of maximum shaft 
horsepower to full dis- 
placement. 


Last two digits of the year 
in which the contract was 
awarded. | 


Total maximum output of 
all generators. 


Propulsion weight plus 
auxiliary weight. 


For prototypes, this takes 
on the value of LSW. For 
non-prototypes, it has 

the value zero. 


O = no launchers; 1 = а 
launcher at one end of the 
ship; 2 = a launcher at 
each end of the ship. 





Do. 


D. 


24, 


25. 


Characteristic 


Armament 
Weight-to- 
Light Ship 
Weight Ratio 


Engineering 
Weight 


Payload Weight 


Engine and 
Payload Weight 


Symbol 


AR/LSW 


ENGWGT 


PAYWGT 


ENGPAY 


Units 


long tons 


long tons 


long tons 
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Definition 


Ratio of armament weight 
to light ship weight. 


Total weight of all 
propulsion, electrical, 
and auxiliary equipment. 


Total weight of all Ctc, 
armament and outfitting 
equipment. 


ENGWGT + PAYWGT 





Category 
No. 


1 


APPENDIX B 


BASIC CONTRACT COST CATEGORIES 


Category Name 


Hull Structure 


Propulsion 


Electric Plant 


Comunication 
and Control 


Auxiliary 


Outfit and 
Furnishing 


Armament 
Design and 


Engineering 
Services 


Construction 


Includes 


Shell plating and planking, logitudinal 
and transverse frames, decks, super- 
structure, armor, etc. 


Boilers and energy converters, propul- 
SjJor units, uptakes, propulsioen control 
equipment, feedwater and condensate 
system, etc. 


Electric power generators, power 
distribution switchboards and cables, 
lighting systems, etc. 


Navigation equipment, interior communi- 
cation equipment, fire control systems, 
radar systems, radio communications 
systems, Sonar systems, eto. 


Heating, ventilating, air conditioning, 
plumbing, elevators, arresting gears, 
rudders, etc. 


Hull fittings, nonstructural bulkheads, 
paintings, equipment for work shops, 
furmishines for quarters, etc. 


Guns and gun mount, ammunition handling 
and storage systems, other weapon systems 
handling. and storage systems, etc. 


Contract drawings, working drawings, 
technical manuals, lofting, mock-up 
and models, etc. 


Staging, scaffolding and cribbing, 
Paunening, trials, cleaning ship, 
dryacc- ne, есе. 
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Miscellaneous 
End Cost 


Weapons 
End Cost 


Electronics 
End Cost 


APPENDIX B (CONT. ) 


END COST CATEGORIES 


Disaster costs; cost of hull, mechanical and 
electrical changes; post-delivery costs; etc. 


Weapons costs after contractor delivery; 
missile, ASROC systems; etc. 


Electronics costs after contractor delivery; 
radar, NIDS, fire control systems; etc. 
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PURGE. ii ppl pr eee er 


κ ον πα. Fa gel e Rides s леч 


АРРЕМХОТХ С 
СОМРШЫТЕК ОШТРПТ 


MODEL B - 9 CERs - 36 OBSERVATIONS 


MULTIPLE RECFESSICN.....CENFAL 
ЗЕЕ ТЕ оа 


БЕРЕСІЛШЕЗСЛЕРС 2072 114 
BERSTESEUARFESEREERESSION CEEFICIENTS 


С.С4С621 06 126546 
SI РЕЕКЕЕСЕРЕ Е5ТІМАТЕ = 0.€C52304 
COVARIANCE VATRIX ΓΕ (THE ESTIMATES 
ο οτε τε ο πε ο τος 
“ee occ toe C. 2108CLD=C2 
ADMIS EDEMEIEPPEE CERRECATICN COEF ICIENT 0.72013C 


ҮСІТІР(ГЕ КЕЕСЕЕ55ІСК.....СЕЛЕДІ 
SELECTICN. 002 


SELEC BIERSTARE 072023321 
БЕЛЕМЛЕ ТКЕБРКЕЕСЭГОМФЕРТСТЕТТ 


20 ECÓNAC zes. SIEAS C.00C72S 
STE. ERRCR CF ESTIMATE= 1.013$78 
CCVARIANCE MATRIX CF THE ESTIMATES 
PESCA LE.  εἰσοτοι Os 260 750-05 
ο ο το ος το 2921, 2CE 0. І526240-0%9 
ο ο το νο ieee CORRELATION COEFICIENT ο. 124560 
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PEPER SER ESSIEN <.cew.CENRAL 
SELECTIENS .... 3 


SEIEECTRENOOARL 0-4 -216z- 
BEEN CUSRESSRECRESSTON CGEFICIENTS 


С.14Е642 e 0526501 
STG. ERROR OF ESTIMATE= 2268126 
CCVARIANCE MATRIX CF THE ESTIMATES 
паса οι C217 S1leb—-€3°-0.1C1L(9D0-0)1 
ο ο τι ο бетсгсап-СІ- -С.25 17650-02 
ο 20127229 782,202. 0,439€E 10-02 
РОС ЕЕРЕЕ РЕСЕ ЕРКЕЕВА САМ COEFICIENT O.€€C92 i 


MULTIPLE RECRESSICN. oe .CENRAL 
ΕΕ Ες Το ος. 4 


SELECI Mei CARE. CS 2)1725 
lI A τω τος REGRESSIGN CCEFICIENTS 


ο τοι απ... C ES 
al. CRRCR OF ESTIMATE- ο σος 
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ο πο Ες Ες TUN sc. ee CENRAL 
ОБ ЕСЕ ГК 2252275 


ЕЕ |Ο {ἐπε 118 
ας νο ο ος ΕΕΕΡΕΞΟΤΟΝ TLEFICIENTS 
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MODEL D - 4 CERs - 36 OBSERVATIONS 


MULTIPLE REGRESSICN.....GENRAL 
SELECTION ur es l 


SEKEGTREN CARD 0977121 
БЕЛ ПБОШМАКЕЗ КЕСКЕЗЗГӘМФРВФЕРІСТЕМТІ5 


0.410823 0.001158 
STD. ERRGR OF ESTIMATE= 0.804216 


COVARIANCE MATRIX CF THE ESTIMATES 


07132440 ОО -0.358 3CD-=04 
55Ο 02112140--04 


αρα ο ΕΡ ΤΟ ΠΕ CCRRELATICN COEFICIENT 0. /72147 


MULTIPLE REGRESSICN... .  GENRAL 
SELECTION: eroe 2 


SELECTIONTCARD 028 23341 
EAS SQUAPESERIORESSION COEFFICIENTS 


0.005228 0.286414 -0.651530 


STD. ERRCR OF ESTIMATE= 1.070823 
COVARIANCE MATRIX CF THE ESTIMATES 
0.267840 CO -C.21842D C2 0.36659D 02 
τι: ΙΟ: OS οσο 04 =0.217/1D 05 
ο το ο 0.21 FED C5 O. 215810 06 
ο ο το ПЮИЕРТІРІРЕ CORRELATICN COEFICIENT 0.891135 
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MOI CPEs REGRESS TON ос GENRAL 
SELECT TUN. 057 3 


КЕЕ С Г ОМ ЕЛЕК ОЗО 22128 
Denon ο ΑΕ ΕΕ ΣΤΟΝ COEFICIENTS 


-6.789734 0.0С585С 6.664107 
SU. ЕКЕПГЕЙЕР ЕЗ5ТІМАТЕ- 4.824125 
COVARIANCE MATRIX CF THE ESTIMATES 
ο οποιο, ειπε 2 0.219870 01 
мама тарата ο ιο. ρου ο. "5 {ο ορ 
ο ο οι τοις ρε .0.39246D 01 
ADJUSTED MULTIPLE CORRELATICN COEFICIENT 0.844043 


MULCT IPCE FEGRESSICN.,... ...GENRAL 
SELECTION. oc ee а 


SELECTION CAROD 04C 21523 
CEAS TFS QUARES REGRESSION COEFICTENTS 


-1.014043 0.005556 0.002013 
STO. ERRCR OF ESTIMATE= c 235319 
(AI A JCE MATRIX PF THE ESTIMATES 
0.55 ο το. δα 1 α-ςἳ —09195420—05 
ο." ΠΡ C.4304270-Ce -0. 36535D-0/7 
πο ο ον ποσο τοι 0.68260р-07 
Αρ ο πες ШЕ PLE CORRELATICN COEFICIENT 0.824401 
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APPENDIX D 


COMPUTER PROGRAMS 


A. JOINT GENERALIZED LEAST SQUARES PROGRAM 
ШОШО ЕР оош ους τοῦ ιοἵ 

The joint generalized least squares computer program 
is designed to read in a set of data and then carry out joint 
generalized least squares computations as specified on a con- 
trol card, and selection cards. The program uses a number 
of IBM 360 Scientific Subroutine packages to do the calcula- 
tions. It is programmed using FORTRAN IV language much like 
the Multiple Regression program in the scientific subroutine 
package (REGRE). The program conducts a number of standard 
multiple linear regressions (one for each subsystem CER). 
The residuals from the single regresions are saved and uti- 
lized to compute a matrix of correlations between selections. 
Both of these items are listed in the output. Next the 
program does the joint generalized least squares calcula- 
ños; Initially 3, the matrix of mean squares and products 
of the least squares residuals, is computed, next р the 
joint parameter estimate vector is computed along with V(b 5) 5 
the covariance matrix of the joint estimates. Finally, a 
set of joint generalized least squares prediction interval 
values is calculated. The program was designed to be easy 
to use for analysis utilizing the joint generalized least 


squares method. Double precision was used to improve accuracy 
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by reducing roundoff errors. The program will handle up 
Boschirty-six observations and nine subsystem relations. 
Each subsystem CER may have up to three explanatory variables. 
The program takes 280 K of core storage space to run with 
a maximum run time of about thirty seconds. It should be 
noted that larger dimensional problems may be possible but 
computer capacity rapidly becomes a constraint to be con- 
cerned with. The scientific subroutine ARRAY was used to 
allow variable dimensioning so that those subroutines that 
deal with matrices can operate on any size array, limited 
only by the maximum program dimensions. 
ο ως Реовгаш Users Guide 

The program listed herein is straightforward to use. 
The user must supply as input a data deck of independent and 
dependent variables. The data array is presently programed 
to store up to forty-one variables and up to thirty-six 
observations for each variable. The user should supply the 
appropriate read statements in the program to accommodate 
564 format he is using. After the data is read in any 
transformations desired may be made. 

ОПЕН Сава 

| One control card is required for each program 

and is read before the data deck. This card is prepared 


as follows: 
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COLUMNS 


1-6 
{-11 
12-13 


14-15 


197 


CONTENTS 
Problem Name 
Number of Observations 


Number of Variables 


Number of Selection Cards 


Selection Card 


SAMPLE 
Escort 
36 
4] 
04 


The selection card is used to specify the type 


of transformation desired, the dependent variable and a set 


of independent variables in a subsystem multiple linear 


regression analysis. 
each subsystem in the model. 


as columns in the data array. 


as follows: 


COLUMNS 


1-2 


3-4 


5-6 


7-8 


9-10 


ME a 


One selection card is required for 


CONTENTS 


Transformation Code 
00 Linear 
01 Log Linear 


Dependent Variable 
Designated for the 
Regression 


Number of Independent 
Variables Included in 
Regression 


15% Independent Variable 
Included 

nd d 

2 Independent Variable 
Included 

I : 

3 Independent Variable 
Included 
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The variables are designated 


The selection card is prepared 


SAMPLE 


00 


3T 


01 


el 





The input format 3612 is used for the selection card. 
с. Deck Setup 
The deck setup to run the program for a number 
Selections is as follows: 
i Main Program 
Сс CoOntrol Card 


3. Data deck (Read statements must be supplied in the 
main program. 


4. Selection Cards (One selection card for each subsystem 
multiple linear regression). 


The joint generalized least squares program is listed in the 


following section of this Appendix. 
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